This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGffiLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



(12) 



UK Patent Application „«GB ,,,,2 331 905 .,3, A 



(43) Dateof A Publication 02.06.1999 



(21) 


Application No 9825571.4 


(51) 


INT CL® 






G06T 15/00 


(22) 


Dateof Filing 20.11.1998 








(52) 


UK CL (Edition Q ) 


(30) 


Priority Data 




H4T TBEC 




(31> 08975133 (32) 20.11.1997 (33) US 










(56) 


Documents Cited 






GB 2288303 A GB 2275402 A US 4974176 A 


(71) 


Applicant(s) 




US 4727365 A 




Real 3D 




WEB Paper, *'S.4 Anisotropic Texture Filtering**, at 




(Incorporated in USA • Delaware) 




URL: http://www.sgi.com/s0ftware/0pen9l/ 




12506 Lake Underbill Road, Orlando. Rorida 32751^ 




advance98/notes/node37.htmI 




United States of America 










(58) 


Field of Search 


(72) 


Inventor(s) 




UK CL (Edition 0 ) H4T TBBA TBEA TBEC 




Harry Charles Lee 




INT CL® G06T 15/00 15/10 15/50 15/60 




1 




ONUNE: WPL INTERNET 


174) 


Agent and/or Address for Service 








W P Thompson & Co 








Celcon House, 289-293 High Holborn, LONDON, 








WC1 V 7Ha UnHed Kingdom 

1 







(54) Abstract Title ! 

Anisotropic texture mapping using silhouette/footprint analysis in a computer image generation 
system 

(57) Anisotropically mapping of texture infomiation to each pixel required for display of each of plural 
polygons forming each scene on a CIG display in a computational efficient manner, uses the footprint of each 
transformed pixel silhouette, as mapped from image space into the texture array, to determine an anisotropic 
texture space area having both a related length and a related width, in which complete texels and texels 
fractions are covered by that pixel footprint. A set of unnormalized line equations characterizing a particular 
pixel footprint is used to determine whether each texel or subtexel in the vicinity of that pixel footprint is either 
enclosed or avoided by (i.e. inside or outside of) that projected pixel footprint. 
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At least one drawing originally filed was informal and the print reproduced here is taken from a later filed forrnal copy. 
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ANISOTROPIC TEXTURE MAPPING 
USING SILHOUETTE /FCXJTPRIMT ANAI.YSIS 
IN A COMPUTER IMAGE 6ENERATIC»r SYSTEM 



The present application is directed to a 
computer image generation (GIG) system, also 
referred to as a graphics accelerator/ for the 
10 display of two-dimensional (2D) representations 
of I three-dimensional (3D) scenes andr more 
particularly, to novel methods and apparatus 
for mapping textiare anisotropically to each 
display pixel by silhouette analysis of each 
15 display space pixel required for each of a 

plurality of polygons forming each/ preferably 
real-time, scene on a CIG display, in a 
computational efficient manner. 
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It is now well known to provide a computer 
image generation system, and associated 
processes, for generation of 3D image scenes 
upon a 2D display; each scene may contain many 
thousands (typically, over one million) of 
individual. picture elements, called pixels, 
with each pixel having visual attributes unique 
to that corresponding small visible area in a 
2D image space representation of the 3D object 
space then observable by a viewer situated with 
a certain orientation relative to the objects. 
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The objects themselves are viewed from a taiown 
obsexrvatlon point, and nay thus be represented 
by a set of planar surface polygons, which may 
be textured, by projection Into texture space 
for convolution with the tescture elements 
(texels) of selected texture patterns, prior to 
display. The various aspects of a CIG textured- 
polygon process may be had by reference to 
available texts and to previous Letters Patent, 
including U.S. patent 4,727,365 (Advanced Video 
Object Generator, issued Feb. 28, 1988) and 
U.S. patent <4, 974, 176 (Microtexture for Close- 
in Detail, issued Nov. 27, 1990), both of which 
patents are assigned to the assignee of the 
present application and are incorporated herein 
in ^ their entireties by reference, along with 
all of the references cited therein. 

It has been observed that most texture 
mapping ai^roaches used in real time and with 
interactive graphic systems can not achieve a 
quality texture mapping for shallow viewing 
angles of textured objects (relative to the 
plane of the object polygon), i.e. where the 
object to be textured has a high aspect ratio 
(i.e., with a high angle of viewing incidence, 
generally greater than 45«, with respect to the 
polygon normal) . An example of this is the 
"White Line Down the Center of the Road- 
problem: in the real world, the broken white 
road line is a series of white line segments 
each about 10 feet long and 5 inches wide with 



each white line segment separated by 10 feet of 
black pavement. Display of a 2D representation 
of a real 3D white road line would try to 
achieve two conflicting goals: first, to 
prevent the white line from disappearing as an 
observer looks down the road; and second, to 
prevent the resulting displayed white line from 
scintillating - here, scintillation is manifest 
as the appearance and disappearance of 
different sets (say, 50 feet lengths) of 
several white- line segments along the road. 
Another related example of these problems is 
the change in building features that are sharp 
when facing the viewer and either scintillate 
or take on a soft appearance when viewed at a 
high aspect ratio (shallow angle to the 
viewer) . Most of these problems are caused by 
a failure to account for the display pixel 
(which usually has a rectangular, and often 
square, silhouette in image space) having an 
elongated footprint when mapped into texture 
space. 

Texture maps are often organized into 
Level of Detail (LOD) sets. Typically, each 
coarser-level member of the set is a texture 
map that is a 2:1 reduction of the nextmost- 
finer set member above it; thus, a level D 
texture map will have 4 (or 2x2) texture 
elements (texels) for each texel in the texture 
map^for the next-coarser level D+1. so, if the 
finest, first LOD (D-0) map has an array of 
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5l2-by-512 texels, the next-coarser LOD (D=l) 
is a texture map that is made up of an array of 
256-by-256 (or 256x256) texels. This process 
is carried out, for this example/ until LOD 9 
yields a map with a single 1x1 texel. 

In hitherto normal texture-to-pixel 
mapping, the effective LOD of each pixel Is 
calculated for both of the width and length of 
that pixel as projected in texture space and 
^he larger of the two effective LOD numbers is 
selected as that pixel's effective LCD. Next, 
two texture maps with LOOs that bracket the 
effective LOD of the involved pixel are 
selected and an interpolation between two 
15 adjacent LOD texture maps is performed, using 

one of 3 interpolation strategies, is performed 
to calculate the value of the mapped pixel. 
The three interpolation methods are: nearest 
neighbor interpolation, bl-linear 
interpolation, or tri-linear interpolation. 

Because the larger of width or length of 
the modified pixel, as projected in texture 
space, is used to determine the pixel's 
effective texture space LCD, the projected 
pixel effective size is forced to have the same 
texture space size in both its length and width 
directions. These texture methods are said to 
be isotropic because the LOD of the mapped 
pixel I are always the same in both directions in 
texture space. However, when normally- 
rectangular (preferably, square) image space 
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pixels are projected onto a object-space 
polygon which Is skewed to some degree with 
respect to the view axis (itself normal to the 
image/display space plane), each projected or 
(texture-) mapped pixel becosies elongated 
because of the shallow projection angle; if 
such elongatioa (the ratio of the greater 
projected dimension to the lesser projected 
dimension) is beyond some selected limit (say, 
3:1) the well )cnown isotropic procedures, using 
the fiction that length equals width, can not 
be accommodated. This is the anisotropic case, 
where the projected pixel footprint dimensions, 
and therefore the associated LODs, can not be 
the same in both directions without causing 
iindesired visual artifacts. 

Zt is highly desirable to provide 
anisotropic texture methods that account for a 
projected pixel elongated shape in texture 
space. Several such methods (usually for non- 
real-time systems) have been implemented by 
approaches which fall into one of two broad 
categories: l) Methods for convoluting the 
pixel texture* space-projection with the texture 
values, for producing very accurate, but 
computationally very expensive, results; and 
2) Methods using the storage of pre-processed 
and pre-filtered textured maps, which require 
less computations but are also less flexible 
and precise, and more memory intensive. 
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I Because of the increasing demand for more 
and more different textures naps to be 
available for real-time and interactive 

t 

systems, the less memory intensive approaches 
are more desirable. In the past, other schemes 
fojp rendering anisotropic texture have been 
suggested (such as a procedure, used almost a 
decade ago by our predecessor simulation group, 
of sampling the texture along only the single 
greater diagonal of the anisotropic pixel) have 
hitherto been found to either provide 
insufficient resolution of the anisotropic 
texturing problems or be too costly (in terms 
of either necessary hardware or computational 

time) . 

I 

; Accordingly, provision of novel methods 
for mapping texture anisotropically to each 
display pixel required for each of a plurality 
of polygons forming each, preferably real-time, 
scene on a CIG display in a coii5>utational 
efficient manner, is highly desirable. 
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In accordance with the invention, ; a method 
for anisotropically mapping texture information 
to. each pixel required for display of each of 
plural polygons forming each scene on a CIG 
display in a computational efficient manner, 
uses the footprint of each transformed pixel, , 
as mapped into the texture array, to determine 
an anisotropic texture space area having both a 
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related length and a related width, in which complete texels and 
texels fractions are covered by that pixel footprint. 

According to a first aspect of the invention there is 
provided an anisotropic mapping method for determining the 
textural attributes of each of plural pixels in a scene to be 
displayed by a computer image generator, including the steps 
of (a) for each pixel, projecting a display space silhouette of 
that pixel as^ a footprint onto at least one associated object 
polygon in a texture space, (b) adjusting a level-off detail 
(LOD) of the texels texturing the at least one polygon, to cause 
that projected pixel footprint to cover at least a predetermined 
number of texels in a selected direction of texture space, (c) 
determining the accumulated number of full and partial texels 
covering the total anisotropic area of that footprint, (d) 
determining the visual attributes for that pixel from the total 
texels accumulated therefore, and(e) storing the determined 
visual attributes information for that pixel, to facilitate pixel 
display in its associated scene. 

According to a second aspect of the invention there is 
provided a computer graphics acceleration method for selecting 
texel data, organized into plural levels -of -details (LODs) , for 
use in display of image space pixels, comprising the steps of 
defining a scene by objects visible therein to an observer, each 
object being defined by at least one polygon appearing in texture 
space and overlaid by a collection of texels, defining a 
footprint of a display pixel silhouette projected onto the 
textured object, defining a boundijig box to cover the entire area 
of the projected pixel footprint; selecting a LOD for the texels. 
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to cause a desired number of texels to lie along a main diagonal 
of the bounding box. and determining the total of all texels 
within the bounding box having a selected geometric location 
lying within the footprint and contributing to the displayable 
attributes of the pixel . 

According to a third aspect of the invention there is 
provided apparatus for anisotropic mapping to determine textural 
attributes for each of plural pixels in a scene to be displayed 
by a computer image generator comprising means, receiving a 
designation of that image-space pixel {P^,) then being processed, 
for mapping an associated pixel footprint onto at least one 
associated object polygon in texture space,- means for adjusting 
a level-of-detail (LOD) of the texels texturing said at least one 
polygon to be covered by at least a predetermined number of 
texels in a selected direction of texture space, means for 
determining the accumulated number if full and partial texels 
covering the total anisotropic area of that footprint, means 
for determining the visual attributes for said pixel from the 
total texels ^ccumulated therefore, and means for storing the 
determined visual attributes information for that pixel, to 
facilitate pixel display in its associated scene. 

Use of a set of un-normalized line equations characterizing 
a particular pixel footprint may be used to 
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determine whether each texel in the vicinity of 
that pixel footprint is either enclosed or 
avoided by (i.e. inside or outside of) that 
projected pixel footprint. By use of an 
isotropic 2D area, rather than a ID line (which 
is only proper for very high aspect ratios 
(typically greater than 70»)), this method 
allows for tallying of the finduded full texel s 
or texel fractions, so as to determine the 
color and/or translucency of the pixel. Since 
all values are determined incrementally, these 
methods initially require the confutation of a 
few values, followed by a simple incrementing 
procedure to tally which texels are included in 
the footprint and which are not. If the texels 
are subdivided, into 2 or more subtexels, each 
subtexel can also be determined to be inside or 
outside of the pixel footprint, permitting more 
accurate texture mapping. A pixel is mapped 
into a higher resolution texture map than its 
effective isotropic LOD would indicate. The 
projected pixel overlaps a number of texels in 
all direction. 

Accordingly, it is one object of the 
present invention to provide novel method and 
apparatus for the anisotropic texturing of 



jSDOCID: <GB 23319QSA | > 



10 



image space pixels using an area! projection 
and silhouette analysis. 

This and other objects of the present 
invention will become apparent to those skilled 
in the art, upon consideration of the appended 
drawings and reading of the associated detaxled 
description of a presently preferred 
embodiment • 

Brief Description Drawings 

Figure la is an Isometric view of an 
Observer frustum viewing a textured polygon 
through the display screen plane in image 
space, and useful in appreciating the 
background of the methods of the present 
invention; 

Figure lb is a plan view of a portion of 
texture space upon which the footprint of a 
square display-space pixel has been projected; 

Figure 2 is a flow diagram for one 
presently preferred embodiment of the methods 
of the present invention; 

: • Figure 2a is a side-by-side comparison of 
the display space screen and a pixel silhouette 
thereon, and a portion of the texture space 
array and the projected pixel footprint 
thereon; 

Figure 2b is a view of texture space, with 
the projected pixel and some of its spatial 
derivatives, and useful in appreciation of 
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several concepts needed for use of the methods 
of the present invention; 

Figure 2c is another view of texture space 
with the projected pixel, and of the bounding 
box added by the methods of the present 
invention; 

Figure 2d is a view of a pixel footprint 
in texture space, showing the four bounding 
lines from which un-normalired line equations 
will be generated for use in the methods of the 
present invention; 

Figxire 2e is a set of siibdivided texels, 
illustrating the use of 4, 9 or 16 subtexels 
for each texel to be processed, to generate 
15 better texture resolution; and 

Figure 3 is a schematic block diagram of 
one possible hardware implementation of the 
preferred method. 



Detailed Description of a Pre sently Preffered 
Embodiment 

Referring initially to Figure la, an 
observer O is at viewpoint 10, viewing a 
display plane 11 which is the image, or 
25 display, space characterized by axes I and J; 
this plane is made up of an array of display 
picture elements, or pixels, 11a of which a 
general array pixel Pij is denominated by its 
respective' I and J axial dimensions. A viewline 
30 10a passes through the center 11c of the pixel 
11a silhouette and is projected as the center 



I2c of a footprint 12a of the pixel 11a as 
projected onto a plane 12 in texture space - 
Plane 12 will, in general, be an object-space 
polygon as projected into texture space and 
will have an array of texture elements^ or 
texels, 12b thereon; the textured polygon plane 
12 has axes S and T, so that a general array 
texcl T« is denominated by its 5 and T axial 
dimensions. It will be seen that the generally 
rectangular, often square, silhouette of pixel 
11a will, because the underlying polygon 12 is 
generally not parallel to the screen plane 11, 
be projected upon plane 12 as a quadrilateral 
pixel P,e footprint I2a typically having four 
unequal sides as well as unequal comers which 
typically are not right angles. 

The texturing problem can be understood by 
reference to Figure lb, wherein the texel plane 
12 is now orthogonal to the reader's sightline, 
so that the texels 12b of the array are 
rectangular, and preferably square, but the 
projected pixel P« footprint 12a has a 
distorted quadrilateral shape. I have selected 
the texture level-of-detail (LOD) such that the 
size of each texel is generally less than the 
size of the projected pixel P«; thus, pixel 12a 
partially covers at least one texel T.« and may 
cen4>letely cover one or more other , texels T',*. 
Here, the texel rows, in the S direction, have 
been labeled a through h, while the texel 
,>«^ii>mn«. "in the T direction, have been labeled 



texels 3e. «e, 3d, «a, 

eacn oi. colot/ transparency 

visual attributes, e.g., color/ *- 

account for the contributions of all tex.ls 
:!tler p«tl.ll^e.cXo.ed or ''^^>^"=^;'«!rTnt 
total area of parUcular pixel P. *~^P"-^ 
iza. in order to 4et.r-i« the proper eoior. 

_j like -Jisible attribates 
translucency and the liKe vi» 

for display at the dieplay »paee eite of that 

pixel Pij. 

Referring now to Figure 2, in one 
presently preferred e.*«dinent of »y novel 
process, a 3D coB^uter image generator (CIG, 
„ay have a graphics processor (which ^ * 
dedicated hardwired logic engine or a software 
programmed general co-iputer) which carries out 
the isotropic-texturiag silhouette/ footprint 
analysis procedure shown in flow diagram 20 

The process starts at step 21. Step 23 selects 
the next polygon 12 to be textured; in this 
einbodiment, pixels »ay be grouped for each 
particular polygon to be rendered by the 
graphics engine, although other methods of 
pixel operation can equally as well be 
utilized, in step 25, procedure 20 selects the 
pair of I and J values of the next pixel P., 
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which is to be texturedr in the presently- 
selected polygon N. This selection effectively 
determines both the image-space coordinates 
(i, j) of the pixel P^j comers and the comer 
coordinatas (s^t) of that pixel as napped 
into* texture space. Referring also to Figure 
2a, a selected four-cornered quadrilateral 
pixel lla has given comers pt through p*, each 
with its associated I, J coordinates, i.e. pi is 
at (ilolj, p2 is at (12, j2), p, is at (13^ j3) 
and p4 is at (i.4,j4). The display pixel P^j 
silhouette lla ia transfozned to the texel 
space pixel P« footprint 12a/ and each of the 
image space comers Pu is respectively 
transformed into an associated texture space 
corner p«, i.e. Pi is at (sl,tl), p, is at 
(s2,t2). Pa is at (s3,t3) and p* is at (s4,t4). 

In step 27, the pixel-to- texel spatial 
gradients are determined and the pixel 
20 footprint is constructed on the texel array in 
step 29. As shown in Figure 2b, the mapping 
gradients, from screen space to texture space, 
are found; the partial spatial derivatives ds/di 
and dt/di are found with respect to first comer 
25 (si, tl) and partial spatial derivatives ds/dj 
and at/aj are then found with respect to second 
corner (s2, t2) . Given these partial 
derivatives, the (i,j) coordinates of each 
pixel p,i,„ can be mapped (which mapping is 
indicated by the -> symbol) into texture space 
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asp...o, i.e. p(ilOl) ->p(sl,tl); P(i2,j2) "> 
P(s2,t2); p{i3,j3) -> p(s3, t3) ; and p(i4, j4) -> 
P(s4,t4). If the first comer (sl,tl) is found 
by the somewhat lengthy projection- 
5 transformation process, the other three comers 
can be found from a knowledge of the 
sidelengths in image space and the napping 
gradients; for the usual sitaation, where each 
pixel has unit sidelengths acting as 
10 multipliers of the associated gradient 
terms, these other comer locations are: 

{s2,t2)-(si+as/ai,ti*at/ai) , 

{s3,t3)-(s2+as/a3*t2+at/aj), and 

( s4 , 1 4 ) - ( si-^as/9j # ti+at/aj ) . 

IS The complete texture space pixel projected 

footprint 12a can be constructed by the ordered 
interconnection of these four comers. 

Referring now also to Figure 2c, step 31 
is entered to consiute a bounding BB box 14 
20 which is a rectangular box just touching one of 
the corner points £ at the greatest and least S 
values and at the greatest and least T values 
of the footprint, and thus encloses the pixel 
footprint 12a. Then, in step 33, there is 
25 calculated the bounding box main diagonal 14 a, 
between the box 14 diagonally-opposed corner 
pair {here, comers p*l and p*3) associated 
with, and closest to, the furthest- apart 
opposite corners (here, comers pi and p3, 
which are further apart than opposite corners 
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p2 and p4) forming a main diagonal 12d of the 
original footprint 12a; it will be seen that 
diagonal I4a is generally congruous to, but not 
identical with, the footprint main diagonal 
12d. Since the bounding box 14 is determined by 
finding the maximum and minimum extents of the 
footprint in each of the S and T directions, 
the process of step 31 can specifically be: 

s«u =» aax{sl,s2,s3,s4) and 

Sboji = min (sl,s2,s3,s4) 
while t«« » max(tl,t2,t3,t4) and 

t^» - min(tl,t2,t3, t41 
where aiax or min signify respectively the 
greatest or least one of the quantities within 
the following parentheses. Here, it is seen 
that s>«»s4 and s^m^sl, while t«««t3 and 
t^„«tl. rrom the foregoing, the graphics 
processor can next calculate the box S range R, 
= (s-„-s^J or (s4-sl) and the box T range Rc 
= (t«„-t«i») or (t3-tl). 

The major direction of the bounding box is 
determined, in step 33, by comparison of the 
maxima of the S extent and the T extent; the 
larger of range R. and range Rt set the major 
direction Dk»; or, Du>. " max{F.,R«) and 
direction, Du=R. if Du.=R. (i.e., if R.>R«) , or 
D^R^ if lW.-Rc (i.e., if Rc>R.) . 

Next, step 35 is entered and the proper 
LOD "D" is determined. To simplify the 
calculations, I have found that the 
quadrilateral footprint 12a can be approximated 



a properly-Sized parallelogram 12A^wxth a 

ZniL Of Visible error, if ^ f^^'^^^^^^^^ 
texels 12b cover each projected pixel footprxnt 
123. I therefore want the pixel footprxnt 
Lndi.. box 14 area to cover -^"^ 
at least one box direction (Figure 2d) , .t xs 
preferable to cover a plurality in both axial 
directiona, although projections with high 
aspect ratios »ay preclude this and allow 
plural texel coverage only along one axial 
direction. Hote that my areal anisotropic 
methods want to have at least one texel, and 
preferably a greater nui.4,er of texels, even in 
the -minor- direction, so as to truly have an 
area of coverage, rather than sai^ling coverage 
only along a line; if high aspect ratio 
footprints are routinely operated upon, use of 
the subtexel situation, discussed hereinbelow, 
is usually warranted, as this allows a second 
dimension to be used with an extent measured as 
a fraction of a texel, and allows a box 14 with 
a vanishing small »inor dimension (less than 
one subtexel, as might be found by a polygon 
plane seen edge-on. at about 90-) to vanish. 
The number T. of texols 12b spanned by the S- 
axis side 14S of the box is calculated and 
compared to the calculated number T. of texels 
spanned by the T-axis side of box 14. The LOD 
number D can be varied to have a desired number 
in the vicinity of either T. or Te; once a good 
value of D is found, the proper texture grid 
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for that LOD is extracted fro. «e«ory for 
in the remaining steps. The texture grxd 
Placement dependents on whether the grid LODxs 
or even, which is a .ea,«re of the 
5 nurf^er of texels spanning the pixel, as the 

finest resolution LOD D is set by examxnatxon 
of the number T„ of the covered texels in one 
direction of the texel grid, as long as the 
condition (T^2-)^ i» Wically, I try 

.0 to have 3-5 texels span the pixel along the 
longer of its S and T ranges. 

in step 37 (referring again to Figure 2d), 
my methods determine whether a texel 12b is 
either inside the footprint (and therefore has 
L5 its color and translucency attributes counted 
in the pixel I2a» or is outside of the 
footprint (and is not added to the increnental 
pixel attributes), by utili2ation of a set of 
four un-normalized line equations (DNI£s) L1-L4 
20 for creating a coarse mapping to determine 

texel inclusion. Each of lines L1-L4 is 

represented by its own ONIE, which is used to 
. determine the inclusion or exclusion of each 
texel, within the box 14, with respect to the 
25 footprint I2a; I sum the contributions of both 
whole (coiapletely enclosed) and partial texels 
12b to form the pixel footprint attributes. 

Using an un-notmalized line equation to 
determine the location of any point, and thus 
30 whether a texel should be part of the pixel 
footprint, operates by having the DNLEs 
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determine which side of tha line the point 
under investigation (say, the center 12b' of 
each texel) is on; if a perimeter point 12a' 
always travels around the footprint along a 
side-line L in a consistent direction (say, 
clockwise), then a point 12b' offset from the 
side-line L in a known direction (say, to the 
right of the line L) will be potentially within 
the pixel - testing the point 12b' with respect 
to all four side-lines L1-L4 will determine 
inclusion or exclusion. 

Therefore, the first step in the ONLB 
process is to generate tha four un-noxnaliiod 
line egustiens; I presently prefer a UNLE of 
the form L»Lo+ (L^s) ♦ (LtX^t) . For example, the 
first IIMLE, given end poiats (sl,tl) and 
(S2,t2), has coefficients of Ld«(s2xtl)- (slxt2) , 
L,-(t2-tl), and L«»(sl-s2). Each of the four 
UNLEs thus describes an edge of pixel footprint 
I2a. Each texel I2b can be tested to determine 
whether it is inside or out; this testing is 
eased if the footprint of a pixel in texel 
space is approximated by a parallelogram 12A, 
where each of the 4 sides of the parallelogram 
is a line described by an UNLE; the best-fit 
parallelogram 12A is usually one in a bounding 
box 14 having a major diagonal 14a close to 
the greater diagonal, between furthest opposed 
corners, of footprint 12a. Then, a point (say, 
a particular texel center 12b*) is inside the 
footprint parallelogram 12A if all UNLEs yield 
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a posiUve value for that point 12b'. A four- 
bit indicator word is associated with each 
point to be tested; each bit is set by the 
Hsults or testing in the associated ordered 
UNLE (e..., the word has bits WXYZ, where W as 
the sign of the first, or LI. UW* test X is 
tne sign of the L2/second D»LE test for that 
same point/ Y is the sign for the L3 OHLE test, 
and Z the fourth ONLB test result for line 1.4 ) . 
If a particular one of the four UNLB tests ±z 
positive, one of the 4 bits associated with the 
point is set to 1, otherwise, a negative result 
generates a 0 bit; this process is done for 
each of the 4 line equations and those points 
with value of (HH binary) or (X5 decimal) are 
said to be inside the pixel footprint. For 
example, a first texel center point 12b' -1 has 
UNLE results of or binary 0011-3 decimal 

and is outside the footprint 12a, while another 
centerpoint 12b«-2 has ONlEs of or 
binary 1111, and is inside the modified 
footprint' 12A. 

The use of four UNLEs can be simplified to 
two UNLE equations if the pixel footprint 12a 
is forced to be a parallelogram 12A with two 
sets of spaced-apart parallel sides, having two 
sets of parallel line equations with the same 
coefficients. As previously mentioned, 

L»Lo+ (Lp^s) ■»- (Lc3^t) , 
where, for a first point at Csa,ta) and another 
point at (sb,tb), ^s=sb-sa and /^t«tb-ta; for 



r.A 1*2 t2) this becows Ll-((s2xtl)- 
(5l,tl) and (52,tZ) w tiixAt). A line 

L3 parallel to the above line LI ha. 
csl!a tl*b) end (s2.a,t2*b,, where a and b are 
conatante. Thus, a -ra-el^^^^^^^ wou.d 
».ave a first term of L'p-ls2.a) x(tl*b) 
lsl.a)xlt2.b,; Which ia the same as L^I. ^ 
CL..a)-(I.xbl; or L'^l^-lc; where 1^ "^^^^ 
(Uxb) - However, L'.-U and L',.L., so L »L*^ 
Where /v is the ta,b) offset. 

in step 39, under raster-lllca uniform 
incrementation in both the "s- and "t- 
directions, the texels 121, enclosed in the 
footprint 12A can be found by using the UNLEs 
to detennine the nunO^er of texel center pcxnts 
12b' enclosed by the projected pixel footprint. 
If a binary word containing all I's (x.e., 
nil,) is calculated for a particular texel, 
that texel center ia enclosed and the subject 
texel contributes toward the pixel attributes, 
otherwise the texel center is outside the 
footprint and the texel does not contribute to 
the tally. The graphics processor of the CIG 
nay work from left to right, along each texel 
row (i.e., with changing s values passing 
through the entire re<iuired range) before 
incrementation of row number (i.e., change m 
the t value) , calculating the new UNLE-based 
results for each of the texels: start in the 
upper left-band comer of the bounding box 14 
in texture space, calculate the full equation 



for each of the 4 UNLE to determine each texel 
centerpoint location relative to the footprint; 
the value of the next texel centerpoint to the 
right is calculated by saving the previous 
value for each equation and incrementing saved 
values by their associated this 
incrementation process continues across the 
row; and the same subprocess is performed for 
each succeeding row, with incrementation of the 
associated /^t amounts, until all texels within 
the bounding box 14 are considered. The 
graphics attributes (e.g.r nvnnber) of texels 
having their centerpoints 12b' enclosed in the 
footprint are processed (e.g., added) to obtain 
the textured pixel value. 

! Step 41 totals the center-enclosed texel 
contributions of all texels 12b that achieve a 
midword result from the line equations, i.e., 
ajre turned "on**, with a color/ intensity 
contribution of 1, or else that texel is turned 
••off, with 0 (no) color/intensity contribution 
to the pixel total. It will be seen that the 
texturing effects of all texels having centers 
within the total area of the pixel projection 
footprint r are contributing to the pixel 
texturing, whether the projected pixel has a 
high aspect ratio (i.e., one of the width or 
length footprint dimension much less than the 
other dimension) or a low aspect ratio (i.e., 
substantially equal width and length of 
footprint 12a); this process will differentiate 
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between a polygon at an angle of about tan' 
(2T)/ where T is the aininun number of texels 
in the LOD selected for the maximuB axis of the 
footprint (the minlauni critical dimension in 
5 the minor axial direction is the distance from 
edge to center, or about one-half the texel 
dimension, so that e.g., for an LOD yielding 
about 5 texels along the major axis of a 
particular footprint of an originally-square 
10 pixel, the aspect ratio will be about tan"* (10) 

or about 84*) . 

Step 43 properly processes the step 41 
total, as by averaging and the like chosen 
methodology, to set the pixel texture 

IS properties. This set of properties may be 

modified, in st^ 45, dependent upon any other 
factors present, such as differing pixel 
lighting effects and the like. The anisotropic 
textured pixel value for that pixel is stored, 

20 in the CIG fraae buffer or a separate memory, 

i 

in stejp 47. Step 49 is entered and a 
determination is made of the number of pixels 
remaining to be textured for that polygon N; if 
there are additional pixels, exit 49a is taken 

25 and step 25 reentered, whereupon the pixel 
number pij Is incremented; if no additional 
pixels exist for the present polygon, exit 49b 
goes to step 51. Zn step 51 the same sort of 
detemination is made for additional polygons 

30 in the present scene; if additional polygon 
work is to be done, exit 51a returns the 



process to step 23; if not, exit 51b goes to 
step 53, which ends the texture process and 
passes the process to the next operation. 

Referring now to Figure 2e, to improve the 
quality of the texturing process, each texel 
12b may be subdivided into a plurality of 
subtexels 16; preferably, the division is into 
an equal number s of subdivisions along each of 
the S and T directions of each texel 12b, to 
generate s' subtexels 16, where s=2,3,4, . . in 
the presently-considered texel 12b. Just as 
each texel 12b has its ovm, centerpoint 12b*, 
each subtexel 16 has its own centerpoint 16 », 
used here for determination as to whether that 
subtexel is inside or outside the footprint 
12a. Thus, I prefer to subdivide each texel 
into s* stibtexels, where preferably s»2,3 or 4; 
if s-2, the texel is divided into 4 subtexels 
16a-16d, while if s»3, there are 9 subtexels 
16a-16i, and if s-4, there are 16 subtexels 
16a-16p. It should be iinderstood that s can be 
any integer number of subdivisions along each 
side of the texel, although a square subarray 
within the range of 2^24 generally maximizes 
detail without unduly minimizing processing 
throughput (due to excessively long processing 
time for very large numbers of stibtexels) . It 
will also be seen that the maximum aspect angle 
of the underlying polygon can be almost 8 9' for 
a; 4x4 subtexel array, using an LOD generating 5 
texels in the major texture plane direction; a 



slightly greater aspect ratio, as provided by 
viewing the polygon 12 substantially in its 
plane (for an angle substantially equal to 
90^4lth respect to the normal to the polygon 
plane, will cause the polygon to generate a 
substantially zero contribution to the 
displayed scenic image^ which is desired, as a 
90"* aspect ratio causes the polygon to be seen 
"edge*on" and essentially disappear -no 
contribution should occur) • 

Each texel is weighted by the nu&ber of 
subtexels that are turned onr responsive to the 
sane type of comparison against the signs of 
the four UNLEs. There will, now be s' comparisons 
per pixel and s^ sets of four-bit comparison 
words (NXYZ) to consider; if the comparison for 
any one subtexel is other than (1111), then that 
subtexel is not enclosed in the pixel footprint 
12a and is not considered. Only if the subtexel 
comparison word is (1111) will the subtexel 
value be enclosed and counted in the pixel 
tally. Thus, for exan^le in a 2x2 subdivided 
texel, if 1 subtexel is "on" (i.e. , enclosed 
and to-be-counted)/ the texel value is 1/4; if 
2 subtexels are on, the texel value is 1/2; 
while if 3 subtexels are on, the texel value is 
3/4; and with all 4 subtexels being on, the 
value is, of course, 1 full texel 's worth. This 
comparison la done in a modified step 39, Based 
on the number of subtexels enclosed in the 
footprint, the texel is assigned a weight that 



contributes to the texture color of the pixel 
being textured. 

i As previously mentioned, the LOD is 

preferably adjusted to provide a predetermined 

1 

number of sequential texels along the major 
axis of the projected pixel footprint 12a. 
Occasionally, the bounding box main diagonal 
14a decreases in size to be less than one texel 
length, even in the finest LOD, and an optional 
clamp may be invoked. This clanip will maintain 
the shape of the pixel footprint and its 
cent ro id. The pixel footprint is then sized 
(i.e., magnified) so that footprint 12a fills 
this clamped bounding box 14. Typically, this 
will happen when the viewpoint 10 moves very 
close to the texture polygon 12a and will keep 
the texture from becoming very blocky. Thus, if 
the maximum extent of the bounding box is 
smaller than a texel side in the finest LOD, 
magnify both the footprint and the bounding box 
until the maximum extent is the size of the 
texel, so as to clan^ the pixel footprint to a 
mini m um size of one texel and anti-alias the 
texel in close-in views* 

Referring now to Figure 3, while this 
method can be carried out on a programmed 
general-purpose computer, which acts as the 
graphics processor, a dedicated computational 
machine 60 or ASIC may be equally as well 
provided to carry out the process and 
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computations. Calculating the coefficients for 
each UNLE from 2 points requires the use of 2 
digital multipliers and 3 digital adders. The 
precision of the arithmetic is a function of 
the grid size; integer arithmetic can be used- 

The screen space pixel location is 
provided at Input means 60a, for passage both 
to an input 62a of a pixel- to- texture mapping 
means 62 and to an ix^ut 64a of a pixel 
gradient cosQsutational means 64. Means 62 
has another set of izq>uts 62b receiving from 
input 60b data characterizing the viewline 10a 
(e.9.# angles with respect to an observation 
space frame) so that a set of outputs 62c can 
provide data establishing the texture space 
footprint point P^. The data at output 62c is 
coupled to a flrdt set 66a of inputs to a first 
adder means 66, which has a second set 66b of 
four inputs receiving the four texel space 
gradients from the outputs 64b of means 64; 
means 64 may also receive the ii^ut 60b data at 
an input 64c# If required. The four adder means 
outputs 66c have the (s,t) coordinates of the 
four pixel footprint points pl-p4, 
respectively. From these footprint points, 
available to inputs 68a, a maximum extents 
subprocessor means* 68 calculates and T««x 
and the like, to determine the bounding box 14 
and its major direction dimension 14a, which 
data are passed through output 68b to a first 
input 70a of a divider means 70. The LOD grid 
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aize information provided at input 70b is used 
as the divisor of major dimension values at 
input 70a, so that the number of texels covered 
along the major direction of the projected 
pixel footprint is provide at output 70c. This 
ntunber is used as the address # at input 72a, of 
a log« looJc-up-table means 72, which selects the 
LOD to be used, at output 72b, to an address 
input 73a of the graphics accelerator texture 
memory means 73. Meax&s 73 outputs, at bus 73b, 
texal/subtexel content/ attribute data. 

Having determined the proper LOD, the 
bounding box comer point information at 
outputs 66c is provided to a set of adders 74 
and multipliers 76 configured to provide 
partial terms of the ONLEs. Their outputs are 
fed to another adder means 78 to calculate the 
four UNLEs. These are provided to a first set 
of inputs 80a of a eoaparator means 80 and are 
compared to the texel/subtexel.data from 

texture memory means 73 output 73b, appearing 

I 

at |another set of comparator means inputis BOb; 
if the texel 12b has been divided up into Q 
subtexels 16, each of the Q different siibtexels 
(here, a 2x2 array of Q«4 subtexels) are each 
compared to the UNLEs by a different one of a 
set of a convarlson means here a quad of means 
BO-l through 80-4. If the sub texel 16x, where 
x»a, b, c or d, respectively, ONLE word is ISh 
then the color attribute data for that subtexel 
is entered into the subtexel accumulator means 
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82; after all Q subtexels are considered, the 
accumulator means output 82a has data for that 
one texeX then being processed. This data is 
passed to the 'sum all texels' accumulator 
means 84, which provides the total teseel 
contributional data for the pixel presently 
being projected, to output 60b, the pixel data 
at output 60b can be further processed or 
entered directly into storage in a frame buffer 
and th« like, for raster (or other) scanning to 
the CIG display means and viewing by observer 
10. 

While one presently preferred embodiment 
of my' novel nethods and apparatus for 
anisotropic texture mapping by silhouette 
analysis has been described in detail herein, 
many variations and modifications will now 
become apparent to those skilled in the art. It 
is my intention to therefore be limited only by 
the scope of the appending claims, and not by 
way of details or instrumentalities set forth 
herein by way of explanation. 
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1. An anisotropic mapping method for determining the 
textural attributes of each of plural pixels in a scene to be 
displayed by a computer image generator, including the steps 
of: ' 

(a) for each pixel, projecting a display space 
silhouette of that pixel as a footprint onto at least one 
associated object polygon in a texture space ; 

(b) adjusting a level-off detail (LOD) of the texels 
texturing the at least one polygon , to cause that projected 
pixel footprint to cover at least a predetermined number of 
texels in a selected direction of texture space ; 

(c) determining the accumulated number of full and 
partial texels covering the total anisotropic area of that 
footprint ; 

(d) determining the visual attributes for that pixel 
from the total texels accumulated therefore; and 

(e) storing the determined visual attributes 

information for that pixel, to facilitate pixel display in 

t 

its associated scene. 

t 

( 

t 

! 

2. The method of claim 1, wherein step (c) includes the 
substeps of: |(cl) constructing a set of un-normalized line 
equations (UNIiEs) to characterize the footprint in texture space; 
(c2) determining, by use of the set of UNLEs, the direction of 
a center of each texel within the bounding box; and (c3) 
including in the footprint total only those texels having a 
center with a predetermined relationship to all UNLEs of the set. 

3 . The method of any one of the preceding claims wherein 
a set of gradients for two-dimensional transformation of the 
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image space into the texture space, are used for construction of 
ONLEs. 



4. The method of any one of the preceding claims, wherein 
step (a) includes the substeps of: (al) constructing the pixel 
footprint as a quadrilateral on an array of texels covering the 
at least one polygon; (a2} constructing a box in texture space 

bounding the -footprint ; and {a3) determining a bounding box major 

direction. 

t 
I 

5. The method of claim 4, wherein substep {a3) includes 
the step of aligning the box major direction with a further-apart 
pair of opposed comers of the footprint, 

6. The method of claim 5, wherein substep (a2) includes 
the step of approximating the footprint by a parallelogram. 

7. The method of claim 6, wherein the parallelogram 
diagonal closest to the further-apart footprint diagonal is 
selected as the box major direction. 

8. The method of any one of claims 2 to 7, further 
including the steps of: traversing the UNLEs in a preselected 
direction about the perimeter of the footprint; and including a 
texel in the total area only if the DNLE results for that texel 
are all of like selected result. 

9. The method of any one of claims 1 to 8, wherein each 
texel is divided into a plurality of • subtexels, and all of steps 
(b) - (d) are carried out for each subtexel . 

10. The .method of claim 9, wherein step (b) further 
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including the step of selecting the LOD to cause at least 5 
texels to coyer the pixel footprint in the selected direction. 

f 

11. A computer graphics acceleration method for selecting 
texel data, organized into plural levels-of -details (LODs) , for 
use in display of image space pixels, comprising the steps of: 
defining a scene by objects visible therein to an 

observer, each object being defined by at least one polygon 

appearing in texture space and overlaid by a collection of 

texels; 

defining a footprint of a display pixel silhouette 
projected onto the textured object,- 

defining a bounding box to cover the entire area of the 
projected pixel footprint; 

selecting a LOD for the texels, to cause a desired 
number of^ texels to lie along a main diagonal of the 
bounding box; and 

determining the total of all texels within the bounding 
box having a selected geometric location lying within the 
footprint and contributing to the displayable attributes of 
the pixel. 

12. The method of claim li, wherein each texel is 
subdivided into a plurality of subtexels, and further including 
the steps of determining sufapixels as contributing to the visible 
attributes of the pixel if the selected geometric location of the 
subtexel lies within the footprint. 

13. The' method of claim 12, wherein the selected geometric 
location as the, center of the subtexel being tested for inclusion 
in the contributing set. 
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14. The method of claim 11, 12 or 13, wherein the selected 
geometric location is the center of the texel being tested for 



inclusion in the contributing set 



15. The method of claim 11, 12, 13 or 14, wherein plural 
un-normalized line equations are compared to the selected 
location to determine inclusion of the associated texel in the 
contributing * set . 



16. Apparatus for anisotropic mapping to determine textural 
attributes for each of plural pixels in a scene to be displayed 
by a computer^ image generator comprising: 

means/ receiving a designation of that image- space 
pixel (P,j) then being processed, for mapping an associated 
pixel footprint onto at least one associated object polygon 
in texture space; 

means for adjusting a level-of -detail (LOD) of the 
texels texturing said at least one polygon to be covered by 
at least a predetermined number of texels in a selected 
direction of texture space; 

means for determining the accumulated number if full 
and partial texels covering the total anisotropic area 
of that footprint; 

means for determining the visual attributes for said 
pixel from the total texels accumulated therefore; and 

means for storing the determined visual attributes 
information for that pixel, to facilitate pixel display in 

its associated scene. 
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17. An anisotropic mapping method as hereinbefore described 
with reference to figures la, lb, 2, 2a, 2b, 2c, 2d and 2e of the 
accompanying drawings. 



18 . Apparatus as hereinbefore described with reference to 
figure 3 of the accompanying drawings. 
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FIG. 1A 
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FIG. 2B 
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FIG. 2C 
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FIG. 2D 
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FIG. 2E 
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